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Attention Bar Examiners 


The Bar Examination Service Committee has distributed to you a 
nine-by-eleven inch black binder, labeled in gold letters: “National 
Conference of Bar Examiners—Bar Examination Service.” It contains 
instructions for ordering bar examination questions from the Com- 
mittee and a 1953 catalogue listing by subject matter the questions 
and answers now available to you upon request. We suggest you place 
in that binder, also, this copy of THE Bak EXAMINER so you will have 
for ready reference the additional material on pages 137-163 of this 
issue. 


Published at the office of 
MarJorig MERRITT 
510 Equitable Bldg. 
Denver, Colorado 














H. R. Hahlo, Dean of the Faculty of Laws, Johannesburg, South Africa, chats with 
Thomas H. Adams, Chairman of The National Conference of Bar Examiners. 


Our Annual Meeting 


Bar examiners were exceedingly busy in Boston the week of 
August 24, sandwiching in visits to historic spots with attendance at the 
annual meeting of the American Bar Association and The National 
Conference of Bar Examiners. After sessions they wandered through 
the narrow, crooked streets of Old Boston searching for Paul Revere’s 
home, Old North Church and Fanueil Hall, or satisfying their hunger 
by patronizing nearby famous seafood restaurants. The Town was 
their oyster; they took it all in and made the most of it. One bar exam- 
iner groaned that he had eaten a whole lobster for dinner four nights 
in a row and regretted he couldn’t tackle another. Oh no, his digestive 
apparatus was still functioning, but he was leaving for home! 


There was likewise a great deal to digest at our meetings, as the 
program will show, and at the sessions were very enthusiastic judges, 
examiners, and law school deans and professors from all parts of the 
country. The attendance prize, if we had one, would have been award- 
ed to H. R. Hahlo, Dean of the Faculty of Laws, Johannesburg, South 
Africa, with possibly Thomas E. Grady, Chief Justice of the Supreme 
Court of the State of Washington, and Benjamin Ortiz, Associate 
Justice of the Supreme Court of Puerto Rico and Chairman of the 
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Bradford H. Hutchins, Secretary of The Maine Bar Examiners, Clarence J. Young 
of the Oregon Board of Bar Examiners, and Goscoe O. Farley, Secretary of the 
California Committee of Bar Examiners, prove they attended the Boston meeting. 


Board of Bar Examiners for that jurisdiction, as runners-up. And the 
bar examiners were there “from Maine to California.” Proof of this 
cosmopolitan attendance you will see in this and future issues of The 
Bar Examiner. 


The dessert at the luncheon session of the Conference was the talk 
by Walter Powers of Boston, Chairman of the Massachusetts Board of 
Bar Examiners. He read some bar examination questions prepared, 
but never given, by an exasperated examiner—no doubt himself— 
exasperated after reading some bar examination answers. The “pro- 
found” questions brought tears to the eyes of his listeners—tears of 
hilarity. 


The program is printed in full on pages 134-135 and the proceed- 
ings will appear in this and forthcoming issues. 


The most important action taken authorized an appropriation of 
ten thousand dollars so that the Bar Examination Service Committee 
could put into operation immediately its machinery to distribute to 
bar examiners, upon request, examination questions with citations 
and answers, and to furnish statistical data en bar examinations when 
desired, This project is under the direction of John T. DeGraff as 
Chairman of the Bar Examination Service Committee. The machinery 
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A Threesome representing North Dakota: Charles L. Foster, Chairman of the State 

Bar Board, O. H. Thormodsgard, Dean of the University of North Dakota School 
of Law, and Charles L. Shafer, member of the State Bar Board. 


itself will be operated by Edward S. Godfrey from the “branch office” 
of the National Conference at 11 North Pearl Street, Albany, New 
York. The panel discussion beginning on page 137 of this issue gives 
full particulars regarding the method of handling this work, and all 
bar examiners have received a letter and catalogue to inaugurate the 
service. 


The following officers of the Conference were elected: 


Cheirman..................... ee ye _..............Olin E. Watts of Florida 
a TT Le Bert M. Goldwater of Nevada 
RI in cciinicetancastsidelis sadialnipiduicidaaiiciaicnamal Len Young Smith of Illinois 


Walter Powers of Boston, Chairman of the Massachusetts Board 
of. Bar Examiners, Fred M. Mock of Oklahoma City, Chairman of the 
Oklahoma Board of Bar Examiners, and Charles L. Moore ef Cam- 
bridge, Ohio, a member of the Ohio State Examining Committee, were 
elected to serve on the Executive Committee. Thomas H. Adams of 
Michigan, Harry Nadell of New Jersey, Maurice D. L. Fuller of Cali- 
fornia, and John A. Blake of New York continue as Committee 
members. 
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Tuomas E. Grapy C. A. ZARING BENJAMIN ORTIZ 


Chief Justice of the Wyoming Chairman, Puerto 
Supreme Court of Board of Law Rico Board of 
State of Washington Examiners Bar Examiners 


PROGRAM FOR THE BOSTON MEETING 


THE NATIONAL CONFERENCE OF BAR EXAMINERS 
Monday, August 24, 2 P. M. 
Reports of Officers 


Panel Discussion: The Bar Examination Service Committee—Its 
Work and How It May Be of Service to Local Examining Boards 
Report on the Scope and Progress of the Committee 
Source of Questions and Selection 
Evaluation and Revision by the Service Committee 
Adaptation of Questions by the Local Board 
Time Allotment for Answering Questions 
Testing the Effectiveness of the Program—Statistical Data 
Speakers: Len Young Smith, President, Illinois Board of Law 
Examiners 
John T. DeGraff, President, New York State Board 
of Law Examiners 
Harry Nadell, Past Chairman, New Jersey Board 
of Bar Examiners 
Edward S. Godfrey, Executive Secretary, Bar 
Examination Service Committee 
Thomas J. O’Toole, Associate Professor, Villanova 
College of Law 
George H. Turner, Secretary, Nebraska State Bar 
Commission 
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Cuar.es L. Moore 
of the Ohio Bar 
Examining 
Committee 


Car.os B. ELuis 
Secretary, 
Connecticut Bar 
Examiners 





Round Table Discussion 
Social Hour 


Tuesday, August 25, 10 A. M. 


Report of the Nominating Committee and Election of Officers 
Panel Discussion: Registration at Beginning of Law Study and 
Character Examination 
Speakers: Eugene Glenn, Past Chairman, The National Con- 
ference of Bar Examiners 
Arthur Littleton, Member, Pennsylvania State 
Board of Law Examiners 
Lofton L. Tatum, Past Member, Oregon Board of 
Law Examiners 


Panel Discussion: What is an “Approved” Law School?! 
Speakers: Albert J. Harno, Dean, University of [Illinois 
College of Law 
Horace E. Allen, Secretary, Massachusetts Board 
of Law Examiners 
G. Douglas Clapperton, Member, Michigan State 
Board of Law Examiners 
Round Table Discussion 
Joint Luncheon of The National Conference of Bar Examiners and 
the Section of Legal Education and Admissions to the Bar 


Speakers: Marjorie Merritt, Director of The National Con- 
ference of Bar Examiners 


Walter Powers, Chairman, Massachusetts Board of 
Law Examiners 
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FLORIDA WAS THERE! 


Upper photo: Philip J. Fleming, Executive Secretary, Olin E. Watts, Chairman, 
and Nathaniel J. Klein, all of the Florida Board of Law Examiners. Mr. Watts is 
also Chairman of The National Conference of Bar Examiners. 


Lower photo: Henry A. Fenn, Dean, University of Florida College of Law; J. Ollie 

Edmunds, President of Stetson University; John M. Allison, of Tampa, Chairman, 

A.B.A. Section of Legal Education; and Russell A. Rasco, Dean, University of 
Miami School of Law. 























THOMAS J. LEN YOUNG JOHN T. Epwarp S. Harry 
O’TooLE SMITH DrEGRAFF GODFREY NADELL 


Bar Examination Service Committee 


Its Work and How It May Be of Service to Examining Boards 


A Panel Discussion at the Annual Meeting of The National 


Conference of Bar Examiners in Boston on August 24, 1953 


Len Younc SmiItu, President of the Illinois State Board of Law 
Examiners and Chairman of the Panel: Less than a year ago, our 
Conference of Bar Examiners, at San Francisco, initiated a project 
for the improvement of bar examination questions. A resolution 
approved the creation of the Bar Examination Service Committee 
and the appointment of an Executive Secretary to supervise the col- 
lection of questions from examiners and, also, from law teachers,— 
questions suitable for use generally in examinations throughout the 
country. Chairman Adams appointed a committee of eight and the 
committee, in turn, selected an Executive Secretary. Both bar examin- 
ing boards and law professors have made contributions of questions 
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which have proved satisfactory in the past and which they deemed 
serviceable for use by examiners everywhere. In short, the Bar Exami- 
nation Service Committee is today a reality and is already serving the 
purpose of easing the burden of preparing questions for those exam- 
iners who have availed themselves of its facilities. 


To my knowledge, no one was more responsible for the formation 
of the Bar Examination Service Committee than the immediate past 
Chairman of this Conference. And, its success to date is due, in large 
measure, to his efforts as Chairman of the Committee to explain both 
its objectives and mechanics to examiners and teachers. Our aim this 
afternoon is to familiarize those few who may somehow be unaware 
of the most ambitious undertaking of the Conference in its history 
and to answer the queries of those who seek additional light as to the 
procedures of the Committee. It is altogether fitting that this forum 
discussion should be opened and closed by the man who knows more 
than anyone else, no doubt more than all the rest of us together, con- 
cerning the aspirations of the Bar Examination Service Committee, its 
accomplishments, and its current status,—Mr. John T. DeGraff, long 
President of the New York State Board of Law Examiners. 


Scope and Progress of the Committee 
Remarks of John T. DeGraff 


Chairman, Bar Examination Service Committee 


I’m afraid that what I have to say may be a disappointment after 
that introduction, but I would like to tell you about the objectives of 
the Committee and what we have done to date so that you can decide 
for yourselves whether this is a project which should be supported by 
the Conference. 


This program, as most of you know, started last year at the San 
Francisco meeting when the Conference authorized the appointment of 
a committee to try to work out a system by which bar examination 
questions which had proved satisfactory in one state could be made 
available for distribution to bar examiners in other jurisdictions. It 
was the hope of the Conference that we could assemble a pool of good 
questions and answers upon which any bar examiner could draw when 
he had to prepare examination questions of his own. In addition to 
making this pool of questions available, the committee was authorized 
to set up a statistical service which would be available to the state 
examining boards, upon request, for making correlations of bar exam- 
ination grades with law school grades. 
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From the very beginning, the Committee has emphasized the vol- 
untary nature of the program. Whether you contribute questions to 
the Committee is voluntary and whether you use the questions as- 
sembled by the Committee is voluntary. No examiner is obligated to 
contribute questions in order to make use of those contributed by 
others. 


Early in February, we sent letters to all bar examiners telling them 
what we proposed to do and inviting their cooperation. We asked each 
examiner to send us ten or more questions, with suggested answers, 
which he considered superior in quality and useful for examination 
purposes in other jurisdictions. We also requested that the suggested 
answers contain adequate citations of authority. 


At the same time, we sent letters to the deans of all approved law 
schools telling them about our program and inviting contributions of 
questions from the law school faculties. We felt justified in doing this 
because of the stake which the law schools have in the sound admin- 
istration of bar examinations. Later, in March, we sent letters to all 
examiners informing them of the availability of the statistical services 
of the Committee. 


Finally, in June, we sent a follow-up letter to each board, asking 
for a statement of their intentions with respect to (1) contributing 
questions to the Committee, (2) using questions made available by 
the Committee, and (3) using the statistical services of the Commit- 
tee.* 


The response has been very encouraging. As of today, 629 ques- 
tions have been contributed to the Committee; 477 of these questions 
were contributed by the boards of seven states and 152 questions were 
contributed by nine law schools. Moreover, sixteen states and fifteen 
law schools which have not yet contributed questions have replied that 
they would do so in the future. 


California contributed 169 very fine questions. Other large con- 
tributors were Illinois with 103 and Florida which, in cooperation with 
the College of Law of the University of Florida, contributed 134 ques- 
tions. A substantial number of questions were also contributed by 
the examiners from Pennsylvania, Georgia, Iowa and New York. 


Sixteen jurisdictions have indicated that they would contribute 
questions in the future as the program progressed. It requires quite 
an effort to review old examinations, to select appropriate questions, 


*The appendix at page 161 contains a summary of the replies from the various 
Boards and Law Schools, as well as a tabulation of the questions contributed to 
the Committee. 
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to have them retyped with the answers and to send them to the Com- 
mittee. Many examiners did not wish to undertake that burden, but 
they did say that in the future, as they were preparing current 
examinations, they would select questions suitable for use in other 
states and send them in to the Committee. 


There are five states that have not yet indicated what they want 
to do about the program. Some of them are awaiting board action. 
Nine jurisdictions have stated that they cannot contribute questions, 
at least for the present. They include Louisiana which operates under 
the civil law, and Guam which cannot contribute questions because 
they do not conduct written examinations. That leaves seventeen 
jurisdictions which have not replied to our letters and this is perhaps 
the most disappointing aspect of our program. 


The other speakers on the panel will discuss various aspects of 
our program in some detail, so I will merely outline our basic ap- 
proach. Originally we had assumed that the examiners would necessar- 
ily request questions by subject classification. For example, we ex- 
pected to get a request from Examiner A for a question in Contracts, 
from Examiner B for a question in Real Property, and so on. Hence, 
we began indexing our questions by subjects. Here, of course, we ran 
into the classification problem, which began to look almost insur- 
mountable. How would we know, if an examiner asked for a question 
in Real Property, for instance, whether we should send him a question 
involving mortgages which his state might classify, for all we knew, 
under Security, or a question on leases which he might classify under 
Landlord and Tenant?. We foresaw mountains of correspondence or 
an unwieldy table of subject classifications for all 54 jurisdictions 
which would have to be constantly amended in order to give an exam- 
iner the sort of questions he had in mind when he made his request. 


Somewhere along the line, we hit upon the idea of the catalogue, 
sample copies of which have been distributed to you. Since we were 
planning to make brief digests of questions on our index cards for our 
own convenience in selecting questions from our files, why not have 
the index printed in the form of a catalogue and let examiners make 
their own selections of specific questions on the basis of a brief sum- 
mary of the legal issues involved in the question? This plan seemed to 
resolve very neatly the whole classification problem: Every examiner 
could see from the catalogue just about what he was going to get when 
he ordered a particular question, the state in which the question had 
been used, the date of its use, the approximate time allowance for 
answering, and the legal issues involved. 
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There were only two possible objections that we could see to 
the plan. They were (1) the expense of printing the catalogue, and 
(2) some degree of security risk. The first objection seemed answered 
by the great saving in correspondence between the Bar Examination 
Service Committee and the bar examiners around the country. The 
security objection, that applicants or cram schools might use the cata- 
logue in preparing for an examination, seemed to us not very serious. 


First, the catalogue would be distributed only to bar examiners. 
While some applicants might have access to examiners’ material, we 
assumed that the number of applicants who might obtain the catalogue 
from an examiner would be very small. Second, the catalogue, the first 
year, would contain a brief summary of the issues involved in more 
than 600 questions. The committee proposes to limit each board to a 
maximum of ten questions on any one examination during the first 
year, with the thought that the limit can be raised each year as our 
stock of available questions increases. Consequently, if an applicant 
did have the catalogue, only ten questions out of 600 or more would 
be used by any one state. Hence, the sheer bulk of the catalogue would 
deter any applicant or cram school from trying to use it. Third, the 
digests in the catalogue merely summarize the issues in each ques- 
tion and suggest the subject matter in a general way, but do not sug- 
gest the answers. 


It seems to us that any student examining the catalogue would not 
find it interesting or useful as study material. To deal with the par- 
ticular issues referred to in the summaries, the student would have 
to engage in considerable research. If he were able and willing to 
make that kind of study of 600 or more questions, he would be pretty 
well prepared for any examination. If this program is adopted by the 
Conference and is successful, the catalogue, in a period of four or five 
years, would contain summaries of two or three thousand questions, 
and this bulk, it seems to us, would discourage any applicant from 
using it for review purposes, if he should be able to obtain access to it. 


Later, with the idea of testing our distribution procedures, the 
Committee conducted a dry run with Len Young Smith, President of 
the Illinois Board, supplying him with a few questions and answers 
from other states. Since the catalogue had not yet been prepared, Mr. 
Smith ordered his questions by subject classification. He will tell 
you about his experience on the receiving end of the program. 


As more questions kept coming in and the details of our procedure 
became more clearly indicated, we began to worry about the quality 
of the questions and answers in our pool. From the nature of our 
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operations as a clearing house; with virtually no research or editorial 
facilities of our own, we felt, from the beginning, that the Committee 
could not assume any responsibility for the quality or usefulness of 
the questions, for the correctness of the suggested answers, or for 
the appropriateness of subject labels. Obviously, if State X sends us 
a question and answer and the Committee cannot do the research in 
the law of all jurisdictions to determine the validity of the answer, 
an examiner in State Y who receives the question will have to do his 
own checking on the answer to make sure that it accords with the 
law of his own state. 


However, despite our disclaimer of responsibility, the fact re- 
mains that when the Bar Examination Service lists a question in its 
catalogue, it is impliedly endorsing the question, at least to the extent 
of saying to all examiners, “Here is a question that is not too bad. You 
are invited to try it out.” So we have done considerable thinking about 
the problem of evaluating questions. Professor Godfrey is going to 
tell you about this aspect of our program. Our Committee was ex- 
tremely fortunate in obtaining the services of Professor Godfrey as 
our Executive Secretary. Mr. Godfrey received his A.B. at Harvard 
and his L.L.B. at Columbia, and for several years has been a pro- 
fessor at Albany Law School. It was his enthusiasm, his industry and 
his facility in organizing our work that enabled us to present this some- 
what ambitious program to you today. 


I think a word of caution should be emphasized at this point. We 
do not wish to create the illusion that all questions furnished by the 
Committee can be used in other states without change. Many of the 
questions will require some modification. It may be necessary to 
change the dates in the question. You may have to change the locale, 
or modify some of the facts to conform to local law. The Committee 
can merely give you the question and the suggested answer with the 
assurance that some state found it suitable for use. The ultimate re- 
sponsibility for the question, as well as the answer, must rest upon 
the examiner who uses it. 


We have been impressed by the great differences in the type of 
questions used in the various states. California, for example, uses a 
rather complex question with the most elaborate and comprehensive 
answers of any of the states. We have distributed a copy of a typical 
California question so that all examiners can see what it looks like. 
You will notice that the answer is three and a half pages long while 
the question itself takes up only a little over a half page. The answer 
is not limited to the law of California; it reviews the general rules 
applicable through the United States. 
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The New York questions are of a different type. A typical New 
York question has also been made available to all examiners. That 
sample question is perhaps a little more complex than the California 
question, but the answer is not nearly as elaborate because in New 
York the answers are based on New York law; we do not examine on 
the law of other states. Some states examine on a national basis, others 
examine on local law. That is a matter which each examiner must con- 
sider in selecting questions from the catalogue. 


There are other differences. New York, Pennsylvania and Cali- 
fornia use rather long, complex questions that take from forty to fifty 
minutes to answer. Some of these questions involve legal issues in three 
or four subject classifications. Other states, such as Illinois, Florida, 
Georgia and Iowa use a shorter type question which takes only fifteen 
or twenty, or perhaps twenty-five, minutes to answer. These differ- 
ences are indicated in the catalogue, so that you can order the type of 
question you want to use on your own examination. Moreover, Mr. 
Smith is going to tell you how you can take one of the long type ques- 
tions from New York or Pennsylvania, revise it a little, and make two 
short type questions from it. 


Finally, there is the problem of financing the program. We start- 
ed last year with an appropriation of $10,000, made available by the 
Conference. I am pleased to report that we spent only a little more than 
$2,000 of that appropriation. We have not purchased any equipment 
We have not reproduced any questions for distribution. The Commit- 
tee felt that it should not attempt to put the program into effect this 
year. We felt that our function should be limited to the formulation of 
a plan, to report the facts and then let the Conference decide whether 
to go ahead with the program. 


The Committee estimates that it will require an expenditure of 
approximately $6,000 or $7,000 a year to solicit, classify, index and dis- 
tribute questions under the program as it has been outlined. A pro- 
gram which involved editorial revision and research would require 
a substantially larger appropriation. 


In concluding this report, I would like to make it clear that the 
Committee is not trying to sell anything. We are not making any rec- 
ommendations. We are merely reporting the facts as we have found 
them. We conceive ourselves to be a fact-finding, working committee 
and in that connection I want to tell you that all of my associates on 
the committee have really worked on this project. All of them have 
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made valuable suggestions and the program we have outlined is a 
composite of the judgment of the members of the committee, who come 
from the East and the West, from large states and from small states. 


In the final analysis, however, the success or failure of this pro- 
gram will depend on the interest and cooperation displayed by the 
examiners in the several states. For that reason, if for no other, our 
Committee feels that the decision should be made by the Conference 
itself. 


Mr. SmituH: We have asked law professors and we have asked the 
bar examiners throughout the country to send us questions. Now we 
want to have a bar examiner and a law professor tell us something 
about the matter of selecting questions. First, we shall hear from an 
examiner, the past Chairman of the New Jersey Board of Law Exam- 
iners, Mr. Harry Nadell. 


Source of Questions and Selection 
Remarks of Harry Nadell 


Past Chairman, New Jersey Board of Bar Examiners 


This topic, “Source of Questions and Selection” by the local board 
sending in questions to the Service Committee, fits in closely with 
the next topic, “Evaluation and Revision of the Questions by the 
Service Committee,” which will be discussed by Professor Edward S. 
Godfrey, Executive Secretary of the Service Committee. If we, of the 
local boards, in going through our own questions and deciding which 
of them are probably usable by boards of other states, follow certain 
standards as nearly as possible, we thereby help in the first sifting 
process and facilitate the work of the Service Committee in evaluating 
the questions which we send in for possible use by other boards. 


In the book published last year of which we all received copies, 
“Bar Examinations and Requirements for Admission to the Bar,” as 
part of the Survey of the Legal Profession by the American Bar As- 
sociation, the Consultant, Professor James E. Brenner, tersely stated 
the purposes of a bar examination. He said (page 42): 


“The primary objectives of a Bar Examination should be to 
test the applicants’ ability to reason logically, to make an accurate 
legal analysis of the problems included in the examinations, and 
to demonstrate a thorough knowledge of the fundamental prin- 
ciples of the law and their application. Bar Examinations should 
not be designed primarily for the purpose of testing informa- 
tion, memory or experience.” 
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In his article on “Improving Bar Examinations” in the same book 
(page 389) , Professor Brenner put the matter in a nutshell in this sen- 
tence: “A bar examination should be a test of professional competence 
in legal reasoning and legal knowledge.” 


He recommends essay type questions “as best adapted to test the 
reasoning and analytical powers of applicants for admission to the 
Bar” (page 42). I think this fits in with the experience of all of us, 
both as teachers in law schools and as members of bar examining 
boards. 


In addition to testing the reasoning powers of applicants, the bar 
examination is also designed to require applicants to prove that they 
are thoroughly grounded in fundamental legal principles and their 
application. A combination of essay type questions covering a number 
of points, and often several subjects, together with a large number 
of yes-no or objective type questions has been found in New York to 
provide the best degree of correlation between an applicant’s grade in 
law school and his mark on the bar examination. On the other hand, 
the great majority of states do not have a large number of yes-no ques- | 
tions, as does New York. Such other states must provide in their essay 
type questions a sufficient number of points in each question to test 
both analytical ability and legal knowledge. 


In any case, whether essay type questions are used exclusively 
or combined with yes-no questions, Professor Brenner points out that: 


“Legal knowledge can be tested only if the scope of the examina- 
tion is broad enough to provide adequate content.” (page 389). 


Then Professor Brenner gives a warning that applies not only to 
bar examinations as a testing device but to the economic welfare of 
lawyers as a class. He says: 


“If the legal profession is to protect itself against encroachment on 
the practice of law by laymen, it must make certain that a suf- 
ficient number of persons admitted to practice law are trained 
and qualified to meet the needs of the public for legal services in 
all fields. If it does not do this, the laymen will step in just as 
they have done in fields of taxation, administrative law, labor 
and titles, and take over work which should be done by lawyers. 
It is the responsibility of the bar examiners to extend the scope 
of their examinations to assure the attainment of this objective.” 
(page 389). 
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Accordingly, in the selection of questions to send to the Service 
Committee, questions in the following fields will be helpful to local 
boards which have not up to now included these subjects: 


1. Taxation 8. Federal Jurisdiction 

2. Administrative Law 9. Future Interests 

3. Labor Law 10. Government Regulation of 
4. Public Utilities Business 

5. Municipal Corporations 11. Insurance 

6. Legislation 12. Corporation Finance 

7. Creditors’ Rights 13. Mortgages 


In his chapter on “Bar Examinations as Testing Devices,” Pro- 
fessor Harold Shepherd stated (page 371 of the same book) that law 
school deans, by a margin of two to one, reported that bar examination 
questions have failed to keep pace with new developments. They 
were asked: “Do bar examination questions keep pace with new devel- 
opments in the curriculum, i.e., taxation, labor law, administrative law, 
etc.?” All or a majority of the deans in 23 states answered, “No,” while 
in only 7 states did the deans express the opinion that the examinations 
had kept pace with new developments reasonably well. Hence the 
need for sending in questions to the Service Committee on the sub- 
jects listed. 


In his chapter on “Administration, Preparation and Grading of 
Bar Examinations,” Professor Shelden D. Elliott reported on the 
replies received to questionnaires sent to members of bar examining 
boards regarding their relative use of various sources in preparing 
bar examination questions (page 328). As to the extent of use of 
decided cases reported in the final appellate courts of the respective 
states, as used in questions on bar examinations in those states, replies 
varied from “seldom” to “more than 60%.” Where cases from other 
states and the United States Supreme Court are also included, the 
percentage ran to as high as 80%. Sources not often utilized included 
cases from the examiner’s own experience and from the various Re- 
statements. Other sources frequently used by bar examiners include 
law review articles, casebooks, law school examination questions, 
treatises like Corpus Juris and American Jurisprudence, and annota- 
tions in American Law Reports. Others include statutes and codes and 
the Annual Survey of American Law published by New York Univer- 
sity and the Annual Survey of New Jersey Law published by Rutgers 
University in its Law Review. 


As to the sources of questions likely to be most helpful to the 
Service Committee, questions based on a systematic review of a good 
casebook or treatise are likely to prove most helpful. 
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In his article on “Bar Examinations as Testing Devices,” Profes- 
sor Harold Shepherd reported on this question asked of bar exam- 
iners (page 372): “Is any attempt made to check the source of the 
questions in any subject, contracts, e.g., against the subject matter of a 
modern casebook or text in that subject or course content in approved 
law schools in your state?” Professor Shepherd stated that only a 
bare majority of examiners answering this question said that they did 
make such an attempt. He also reported that in two states where out- 
of-state professors prepare the questions (California and Connecticut), 
there is at least a check against the course content of the professor’s 
own school. Questions based on a systematic check of the subject 
matter of a subject against a modern casebook or text are likely to 
be most useful to the Service Committee. 


Numerous questions are needed by the Committee in the funda- 
mental subjects where two or more questions are likely to be asked on 
the bar examinations. These subjects include: 


1. Contracts 5. Real Property 
2. Constitutional Law 6. Torts 
3. Equity 7. Corporations 
4. Evidence 8. Trusts 


Questions involving at least two main points are preferable to 
single-pointed questions. Questions that cut across course lines are 
also valuable. For example, a case involving a divorce obtained in a 
foreign state, may combine questions of Conflicts, Domestic Relations, 
and Property. There is every reason to include points from several sub- 
jects wherever suitable. 


It follows from this that single-pointed questions are to be avoided. 
An example of such a question given on the New Jersey bar exam- 
ination five years ago is this: ‘ 


“A ordered from T, a tailor, a suit and overcoat costing $550 
to be made from material selected by A. After the suit and over- 
coat had been finished, although they fitted and were otherwise 
as ordered, A refused to accept them. T commenced an action 
for the price against A, and A in his answer pleaded the statute 
of frauds. Decide the case.” 

Another type of question that is not readily adaptable to use out- 
side of the state where it is given is a question based on a local statute. 
Five years ago, this question was asked on a New Jersey bar examina- 
tion: 
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“At the annual election of the M Corporation, held on April 
17, 1948, A, B, C, D and E were duly elected as directors. At the 
directors’ meeting immediately following, A,B and C voted for 
X, Y and Z as President, Secretary and Treasurer, respectively. 
D and E dissented therefrom because X, Y and Z were not stock- 
holders. Representing D and E, what action would you suggest 
they take and with what result?” 


Also to be avoided are memory questions. Some twenty years 
ago these questions were asked in New Jersey bar examinations: 


“What are the methods of acquiring title to land according to 
Blackstone?” 


“What is owelty?” 


And only five years ago this question was asked on a New Jersey 
bar examination: “State and illustrate three exceptions to the hear- 
say rule.” 


Only questions which are accompanied by a statement of cita- 
tions and reasons are suitable for distribution by the Service Com- 
mittee. 


Questions involving the practice of the local courts are suitable 
only locally, for example, this question asked in New Jersey five years 
ago: “State a hypothetical case to illustrate when a motion for a non- 
suit might properly be made.” However, questions on evidence are 
sought by the Service Committee. 


Types of questions criticized by Professor James E. Brenner 
in his chapter on “Improving Bar Examinations” (page 398) include 
“the memory or encyclopedic type of question,” and the question so 
“complicated with facts and so vague as to legal points that it has no 
value as a testing device.” 


In conclusion, the best types of questions for use by the Service 
Committee include questions with a number of points, covering one or 
more subjects, and involving fundamental points of law, preferably 
based on systematic study of modern casebooks and texts. 


Mr. SmitH: The law professors have been sending us some ques- 
tions; we have received 152 from law schools thus far. Now we would 
like to have the reactions of one of the law teachers as to the methods 
of selecting questions for our use. Our next speaker was formerly 
a member of the faculty of Northeastern Law School, which is clos- 
ing its doors, and he now is joining the law school at Villanova Col- 
lege which is opening its doors this fall, Professor Thomas J. O’Toole. 
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Remarks of Thomas J. O’Toole 
Professor, Villanova College School of Law 


Ladies and gentlemen, apparently my being asked to participate in 
this panel is the reward for having sent in a couple of questions. If you 
wish to get some more questions, you will have to find a different kind 
of reward. 


It seems to me that there are some things that you ought to 
keep in mind about the questions which you are going to get from a 
law professor. If bar examiners come to a professor and ask for ques- 
tions, they are going to get a law-school type question. Now I am 
frankly rather surprised to see the degree of unanimity among bar 
examiners on the proposition that the law-school type question—the 
problem type question, or the essay type question—is the proper type 
question, especially at a time when there is a mounting criticism of what 
the law schools are doing. I am surprised to see that this assumption 
is made. While'I think it is a correct assumption, I should like to point 
out that, to the extent that the bar examinations are intended as a 
check upon law schools, they must not automatically assume that the 
law schools are doing the right things. I happen to think the schools 
are on the right track, but one function of the bar examination is to 
check up on the law schools. If you just borrow the questions from the 
law school, correlate the answers with the school grading, (also on the 
assumption that the law schools are doing the right things) then you 
are sacrificing one significant function of the bar examination. So I 
am glad that the preponderance of the questions are questions which 
have not come from the law schools, but have come from the bar ex- 
aminers themselves. 


Now, in addition to being a law-school question, the question 
will be an old one. It will be one which has been used before. I think 
actually that is a distinct advantage because the real test of the value 
of a question is found in its actual use, and in the reading of the 
answer. One who frames questions may be very proud of the ques- 
tion until he sees the answers. Then he may realize it’s a total bust. 
Therefore these old, proven questions are desirable. Unlike you gentle- 
men who are bar examiners, the law professor knows the student. He 
has had him for a year prior to the examination and he can tell 
whether or not the question has given a fair reflection of the student’s 
ability. Of course, there will be surprises. Unlike the bar examiners, 
the law professors are in a position to have the verification of a ques- 
tion, and not merely in terms of cold statistics. As Mr. DeGraff points 
out, good questions will yield a good spread of grades; but a bad ques- 
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tion might also give a good spread. A law school professor, knowing 
his students, will have,.I think, a very satisfactory check on the ques- 
tion that looks good but actually doesn’t work out well. 


Now where do law professors get these questions? Sometimes 
they wonder themselves. It’s probably the most disagreeable task of the 
year, but I think the general picture is this. Law professors read a lot 
of cases, not only in one jurisdiction but country-wide. I think that’s 
the principal source. In order to avoid the last minute rush, I look 
throughout the year for problems that have promise, problems that 
have promise but need embellishment. Most of us believe that a prob- 
lem that has one main issue isn’t much good. 


Now this, however, will be true of those questions from law 
sehools: with very few exceptions, law schools in this country do not 
have experience with comprehensive examinations. Most of those 
who have had experience with “comprehensive” examinations do not 
really mean comprehensive questions. They mean a question on this 
course, a question on that one, but not questions cutting across sev- 
eral law topics. There has been very little experimentation done. I 
once wrote an examination of about fifteen or twenty questions in- 
tended to be comprehensive and to cut across all the major fields of 
law. When I checked the answers after they had been graded, I found 
the results were very poor. Students found an issue on torts and did 
not look further. They didn’t look for the contract or trust. It seems 
to me that the lawyer has to do that constantly and bar examiners 
ought to be experimenting with questions that truly do cut across the 
field of law. I don’t think you will get questions like that from the law 
school professor. 


There is a danger in a bank of questions. It is not like a blood 
bank where you use up the supply and get fresh blood. This could 
well be a revolving bank. I think we need new ideas, new types of 
questions, new attempts, and if the bank gets so big that those who are 
running it or using it say, “We have enough there, let’s ride on it,” (and 
the temptation may be to do that) we have destroyed what would 
otherwise be a continuous and fresh flow of questions, some of which 
-may be novel, and some of the novelties might well prove to be 
valuable. 


If you want to get more questions from the law school professors, 
a very valuable thing to do is to inform the author of the question 
as to what happened to his question and what use is made of it. If 
he spends a considerable amount of time preparing and forwarding 
a question and he hears nothing more, he wonders if it is being used 
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and if the program is worth cooperating with. I know this program 
is in its early stages, but I think those who are participating and are 
informed what happens to their work will have a feeling that they are 
doing something worthwhile. 


One thing that bothered me when I forwarded questions, (I used 
old ones in which I have pride of authorship) was that I was asked to 
write an answer. Usually I don’t write an answer. I write an outline of 
an answer which serves my purpose because I examine what I taught. 
If I don’t know it then, I am not likely to learn it the last moment. When 
you are asked to send in a question to somebody else, a serious problem 
arises. What sort of an answer should I give? Should I write a brief? 
Or should I write an answer which I think ought to get full credit if 
given by the student in the time allotted for that question? I don’t like 
this business of separating so widely the authorship of questions and 
the grading of answers. There must be some separation, but the danger 
is that a bar examiner might take a question that sounds good and for 
which a very full and complete answer has been submitted, and, with- 
out himself really having gone into it, expect more of the student than 
really should be expected. I think it’s possible but less likely he might 
require less than should be expected. I hope this program goes forward. 
A clearing-house for questions, used flexibly by state examiners, af- 
fords promise of improved bar examinations for the future. 


Mr. Situ: I am sure the members of the Committee will put to 
use the splendid suggestions you have given to us. Now we are going to 
see what happens to our questions once we have submitted them. 
The Conference has been fortunate in obtaining the services of Pro- 
fessor Godfrey of the Albany Law School as the Executive Secretary 
of the Committee, and he will talk to us about the evaluation of ques- 
tions by the Committee. Professor Godfrey. 


Evaluation and Revision by the Committee 
Remarks of Edward S. Godfrey 
Executive Secretary, Bar Examination Service Committee 
I should like, first, to take you all down for a Cook’s tour of the 
workshop of the Bar Examination Service Committee. By way of back- 
ground for thinking about the evaluation of questions and answers 


by the Committee, it will be helpful to know just how the Committee 
proposes to operate. 
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There are two main jobs that the Committee would do: first, 
receive the questions, making evaluation of them from the point of 
view of their potential usefulness to at least a reasonable number of 
states, and from the point of view also of their general adequacy as 
testing devices. After making that evaluation, if the Committee decides 
that the question is not suitable for use in other jurisdictions, the 
question will be discarded, put in an inactive file. If the Committee 
finds that the question is potentially useful for other jurisdictions, 
the Committee will assign a serial number to the question, make an 
estimate of the answering time, and prepare a brief digest of the main 
issues which are presented by the question, and the answer. This digest 
would go into an index arranged by subject classification, and it is 
this index which will later be printed to form the catalogue, copies of 
which have been distributed to you. The second main job the Com- 
mittee would do would be to let examiners know what questions the 
Committee has in stock (by means of the catalogue) and reproduce 
and distribute, as promptly as possible, those that examiners ask for. 
The examiners, by reference to the catalogue, would be able to deter- 
mine the approximate scope and content of each question and ask us 
to make their selections, knowing pretty well what they are going to 
get when they ask for one particular question. 


There is really a third job of the Committee, a sort of post-audit 
control operation in which the Committee would maintain a continu- 
ous evaluation of questions based on the reactions of examiners to the 
questions distributed to them. 


So far the Committee has not taken on the task of editing or re- 
vising questions and answers except to the extent of making obvious 
corrections. That is because of limitations of budget. The systematic 
checking, editing and revising of every question and answer would 
take a great deal of professional time and would run up the cost of 
the program substantially. 


Let us look for a moment at the Committee’s distribution job. It 
is not out of order to talk about distribution first, since the whole idea 
of the program is to pass along good questions, and everything in the 
Committee’s proposed operations is related to that purpose. 


To be specific, let us take the case of Examiner Doe in State X. 
Let’s say that under the arrangement within his state board of ex- 
aminers he has been assigned the job of drafting a certain number 
of short questions in the fields of Bills and Notes, Constitutional Law, 
and Landlord and Tenant. Let us assume that there is no objection 
by the State X Board, as a whole, to any of its members using the 


152 





Bar Examination Service. He decides to try that Bar Examination 
Service. He looks at his catalogue (of which you have sample copies) 
and runs through the questions listed under his subjects. (Don’t 
forget that the catalogue would actually contain several hundred 
questions, and that there would be many more questions under each 
subject than appear in this sample). He looks under Bills and Notes 
(page 4 of the sample catalogue). Suppose he is attracted to No. 157. 
However, he sees that No. 157 was used in Illinois in July of 1952, and 
Doe’s State, X, is adjacent to Illinois and many applicants for the bar 
in State X are graduates of Illinois law schools. He decides that for 
security reasons he’d better not use No. 157. He looks further and sees 
No. 229, from Georgia. No security problem there. State X is geo- 
graphically remote from Georgia. Let’s say he decides he would like to 
look over No. 229. 


He then looks through Constitutional Law (page 5). Here he 
notices No. 191, from New York. He would like to use a Constitutional 
Law question involving a state statute purporting to eliminate jury 
trial in wrongful death actions. But he sees that the catalogue shows 
that No. 191 contains several other issues and that the suggested 
answering time is 45-55 minutes—much too long for his purposes. Does 
that absolutely rule out the possibility of using the question? Actually 
it does not, as Mr. Len Young Smith will demonstrate in a few minutes. 
Let us assume that Examiner Doe decides he would like to order 
No. 191 to see what he can do about revamping it for his own use. 


He then looks for the heading Landlord and Tenant in the cat- 
alogue. He doesn’t find it. He turns back to the Cross-Reference Table 
(page 2) and finds “Landlord and Tenant. See Real Property.” So he 
looks for the Landlord and Tenant questions under Real Property. 
(The sample catalogue was chopped off before it reached Real Prop- 
erty; so that subject won’t be in your sample.) Suppose that Mr. Doe 
decides he doesn’t like any of the catalogue questions on Landlord 
and Tenant and decides to work one up on his own without ordering 
from the Bar Examination Service. 


So he has decided that he would like to order Questions 229 and 
191 from the Service. However, he remembers the restriction men- 
tioned on page 3 of the catalogue, that, for the present, each jurisdic- 
tion should limit its requests to ten questions per examination. Exam- 
iner Doe wonders how many questions have already been ordered by 
the other State X examiners. He decides to get in touch with the Chair- 
man or Secretary or other members of his Board to see what they have 
done and finds that only seven other questions are being ordered 
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from the Bar Examination Service. (I might add that if this program 
gets into full swing, probably the smoothest operation would result 
if each participating state board would give each examiner a quota 
of questions which he could request of the Bar Examination Service). 


So Examiner Doe writes or wires to the Committee, 11 North 
Pearl Street, Albany, New York: “Please send me No. 229 and No. 
191,” and gives his name and address. That’s all there is to ordering 
questions. 


What happens then in the Committee? The Committee Secretary 
gets the request, takes out the folders for Questions No. 229 and 191, 
and finds that No. 191 has already been mimeographed and a copy is 
all ready for immediate mailing, but No. 229 must be stenciled and 
run off from the original copy before it can be sent out. The Secre- 
tary would post a notation to the service record of No. 191 showing 
that it has been sent to Doe in State X on such and such a date. (A 
service record is made up for each question on file and shows every- 
thing that is ever done with it or about it. Among other things, it 
enables the Bar Examination Service to drop a word of caution to the 
examiner requesting a particular question if the Service finds that it 
has already been used in a neighboring state or has been used danger- 
ously often throughout the country.) If the record on No. 191 discloses 
no reason why it should not be used in State X, the question will be 
promptly mailed to Examiner Doe, with a Question Report Form 
attached. I believe you have sample copies of the Question Report 
Form. I would appreciate it if you would look at it for a moment. 


The blanks at the top of the form (page 155) will be filled in by the 
Bar Examination Service. You will note the disclaimer and the note on 
the making of appropriate changes. The Question Report Form proper 
appears below the perforation and is designed to give the Committee 
some idea of Mr. Doe’s reaction to the question. It will be of great 
help in maintaining a continuous evaluation of Question 191, if 
Examiner Doe will fill in this report and mail it back when he knows 
what disposition has been made, or will be made, of the question. For 
instance, if he modifies No. 191 (as he probably will, in order to make 
a short question out of it) and actually uses it in the next State X 
examination, he would check the third box on the form, write in the 
date of the examination, add any comments, and mail it back to the 
Committee. 
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THE NATIONAL CONFERENCE OF BAR EXAMINERS 
BAR EXAMINATION SERVICE 


QUESTION NO. ...... Sere SADE . Sounce: ....... 


| a PF bs eas 


The Bar Examination Service Committee cannot, from the nature of its 
operations, assume any responsibility for the quality or usefulness of this 
question, or for the correctness of the suggested answer, or for the appro- 
priateness of the subject label. 


Note: Where the question refers to dates or a particular locale, appropriate 
changes should be made in the text. 


QUESTION REPORT FORM 


NAME AND ADDRESS OF EXAMINER OR BOARD DATE: 


SERIAL No. or 
QUESTION: . 


commento: ........................... : 


You will help the Bar Examination Service Committee to render more effi- 
cient service to all examiners, if, after consideration or use of the attached ques- 
tion and answer, you will fill out this report and return it to the Bar Examination 
Service Committee, 11 North Pearl Street, Albany, New York. 

CHECK ONE 


[J] Question returned herewith. Not used for reasons stated on 
reverse side. 


C]) Question used on Bar Examination held 


[] Question used in modified form on our Bar Examination held 


~_ a . Copy of question as 


ll be published. 

Any comments you may wish to make with respect to this question or the 
accompanying answer will be greatly appreciated and will receive careful con- 
sideration. Please send us any additional citations you have used and any other 
modifications of the answer you have made. 


The examination in which we are using the question will 
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The Committee will be interested in Doe’s comments. If they are 
favorable, the Committee will feel that it is ‘justified in leaving the 
question in the next catalogue so that other examiners can order it. If 
Doe’s reaction to No. 191 is unfavorable, the Committee will want to 
consider whether No. 191 should be withdrawn from circulation and 
omitted from future catalogues. So, if this program is adopted, the 
examiners’ reactions to the questions sent to them, as expressed on the 
Question Report Form, will be studied attentively and will be of great 
importance as a device for continuous evaluation by examiners them- 
selves of the Committee’s stock of questions. 


You will notice that on the Question Report Form (after the 
third check box) Mr. Doe is invited to send back his modified form 
of the question if he uses it in modified form. That includes any 
modified answers, too. The Committee would like to have the modifi- 
cation because it may be desirable to put it in stock as an addi- 
tional question, or perhaps as a substitute for the original question 
if it seems to be better. 


You remember that Mr. Doe’s other request, for No. 229, could 
not be filled immediately, because no copies had yet been made. 
However, the Secretary somehow quickly gets the original Georgia 
version of No. 229 (question and answer) into the hands of a typist, 
who prepares a stencil. The Secretary then somehow finds a mimeo- 
graph operator who turns out thirty copies, one of which is then 
promptly sent, with its Question Report Form, to Examiner Doe. The 
stencil on No. 229 is filed. An appropriate notation is made in the per- 
manent record of Question No. 229: “Sent to Doe, State X, such and 
such a date.” Later, Doe sends back the Question Report Form on No. 
229, as in the case of No. 191, on which Doe may state his opinion of 
the question and answer. 


When Doe gets his questions from the Committee, I think he 
should approach them critically. In some cases he will find that they 
require substantial modification either in the question or the answer. 
In other cases, he will find that he needs to do very little to the 
question or answer except run down the authorities in his own state, 
which he can probably do by means of the key numbered digests. The 
important thing to note is that the Bar Examination Service would 
not be a substitute for thought and research on the part of examiners 
using it. The Committee hopes the Service will be a real help, but it 
should not be expected to do the whole job for any examiner. 


So much for the distribution process. Let us turn to the other 
end of the operation. Let’s take a different examiner this time, Richard 
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Roe of State Y. Let’s suppose that the Y Board of Law Examiners 
has given all its examiners free rein to participate in the Bar Ex- 
amination Service program. Examiner Roe has a few old bar exam- 
ination questions in his file that he thinks are pretty good with some 
roughed-out answers containing citations of authority to support 
them. He’d like to send them in to the Committee. He wonders about 
those answers. Does the fact that they are not polished make them 
unsuitable for the Committee’s purposes? The answer is No, as long 
as they expose all the issues involved in the question, and show the 
reasoning along which those issues should be resolved and cite at 
least some authority in support of the examiner’s conclusions. The 
mere fact that the suggested answer is not documented with out-of- 
state citations is certainly no reason for not contributing the question. 


Potential contributors, like Mr. Roe, should not hold back be- 
cause their answers are not in shape suitable for law review publica- 
tion. Roe’s test should be: “Will this question and answer in this form 
probably be useful to examiners in at least some other jurisdictions?” 
The Committee realizes that there is no one and only answer, no per- 
fect answer, to a law examination question of the essay type. In fact, 
it is for that very reason the Committee is careful in distributing each 
question to label the answer “Suggested answer.” 


Let us suppose that Mr. Roe sends his questions in to the Bar 
Examination Service. At this point the Service is face to face with the 
evaluation problem: “Is this question of Roe’s worth offering to other 
examiners?” It is not always easy to answer this question. It is almost 
impossible to formulate a standard for examination questions that 
will satisfy one’s self, let alone reconcile all the views of all boards 
and examiners throughout the country. In this matter one is influenced 
by his basic views as to the purposes of law examinations and of legal 
education generally. Here we run into one of those things, like art, 
about which every one has his own opinion and is more or less pri- 
vately certain that it is the right one. 


I can add little to what Mr. Nadell and Professor O’Toole have 
said regarding the criteria of a good question. Personally, I judge 
a question, with its suggested answer, by this test: Is this question 
likely to stimulate answers that will show the extent to which candi- 
dates can comprehend English, perceive and state relevant legal issues, 
and draw conclusions by reasoning from rules and principles? Is the 
question likely to stimulate answers that will disclose the degree to 
which the candidates possess common sense and social insight and 
have, in their preparation, done some honest and independent think- 
ing about the law? 
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These criteria contain subjective elements, of course. Even so, I 
think they should rule out at least the question which presents an 
issue the determination of which by some court was necessarily arbi- 
trary, where the candidate cannot be guided by any discernible 
reason of policy, or legal tradition, or general consistency in the law. 
If all the candidate has to do is remember which way the Supreme 
Court of Y decided the identical issue some years before, or make a 
lucky guess, and cannot get to the result the examiner has in mind 
by some sensible appeal to general legal theory, or social policy, or legal 
history, or the facts of life, I would think that the question is not a 
good one. 


However, there is another aspect of this picture. The contributor 
himself apparently thought the question was at least a potentially 
useful one for other states since he sent it in. That is particularly true 
where a contributor has obviously selected the question with some 
care—in other words, has obviously gone through an evaluation 
process of his own. Particularly in such a case, if I am evaluating the 
question for the Committee, I do not like to give my own views free 
rein and reject the question even though I fear that it is a poor one. In 
the first place, Roe has had an opportunity to see how the question 
worked out in his own state, and there is a rebuttable presumption 
that he is not sending the Committee a question that worked out badly. 
And, second, there is always the possibility that a doubtful question 
from Examiner Roe will turn out to be just what Examiner Doe 
thinks he wants and needs. So, in such a case, within reasonable lim- 
its, the fact that I don’t think anyone ought to want it would not 
weigh too heavily where Roe has himself made a careful selection. 
Where there is no evidence that the question was carefully selected 
by the contributor, the Committee would probably feel more free to 
reject it if it seems to be below par. However, in case of doubt about 
a question, the doubt would probably be resolved in favor of the 
question. 

We should not forget, also, that even a question passed and cat- 
alogued and distributed by the Bar Examination Service is subject to 
further screening: if examiners to whom a question is distributed 
think it is a poor one, they can let us know on the reporting forms and it 
can be removed from circulation. 

So what will happen to Mr. Roe’s questions? They will be screened 
by the Committee from the point of view of their usefulness in other 
jurisdictions and their general adequacy as testing devices. If they 
look satisfactory, they are indexed and filed and announced in a later 
catalogue as available for distribution. If they do not seem to meet 
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requirements, they are simply put in the inactive file and are not cat- 
alogued. (Parenthetically, if Roe has contributed a question and it 
does not appear in the next subsequent catalogue, it doesn’t necessarily 
mean that the question is rejected by the Committee. It may mean 
that the Committee has not got around to processing that particular 
question.) 

Finally, I would like to say a word about the fear that a few ex- 
aminers and educators have expressed, that the Committee’s pro- 
gram will lead to a “stereotyping” of bar examinations and to over- 
standardization. In considering this point, one should remember that 
the Committee’s program is completely voluntary. No examiner or 
board has to use the Committee’s questions or answers as far as the 
Committee is concerned. 


If the Committee’s program is adopted, it will be several years 
before it has enough questions in stock to supply more than a limited 
number of questions to each state using the Service. During that 
period, the bulk of questions in each state will continue to be drawn 
up by the examiners themselves as at present. Later, if the Committee 
ever gets enough questions to eliminate this numerical restriction, 
there will be so many questions in stock on each subject (Contracts, 
Torts, Real Property, and so forth) that standardization will become 
improbable merely by operation of the laws of chance. Moreover, the 
Bar Examination Service has sufficient internal controls to avoid the 
repetition or near-repetition of examinations. 


In any event, examiners using questions and answers from the 
Committee have to study them and do some research. In many cases, 
questions and answers will have to be modified to suit local circum- 
stances. I think any danger of bar examiners becoming lazy as a result 
of this program is pretty remote. And if by chance they have a little 
less work to do as a result of the program, what of it? Whatever its 
deficiencies may be, I don’t think that the program will be an opiate 
for bar examiners. On the contrary, I foresee a valuable exchange of 
ideas for everyone participating in the program. Maybe, after looking 
at some questions from other states, John Doe will decide that there 
are better methods of examining applicants than are currently used 
in his state, and something good may happen. 


There is another aspect of standardization that may be troubling 
some people. It lies in the possibility that the questions in the Bar 
Examination Service pool may themselves tend to take on a certain 
repetitiousness of scope and content. And a situation could develop 
over the years in which the curriculum of the law schools has moved 
in a certain direction (say, for instance, in the direction of greater em- 


159 











phasis on public law in contrast to private law), while the Bar Exam- 
ination Service continues to receive and offer questions on the classi- 
cal subjects. 


If any one is worried about this possibility, there is a two-fold 
answer: First, since the Bar Examination Service is essentially a 
clearing house for questions, its supply of questions must necessarily 
reflect the attitudes of examining boards toward the proper subject 
matter for examinations. The law schools should signalize shifts in 
emphasis in their curricula by discussion with bar association leaders 
and leaders in this Conference in order that the schools and examiners 
may stay reasonably in step with each other. If they get out of step, it 
would not be the fault of the Bar Examination Service program. If 
scholastic curriculum changes are generally recognized and accepted 
by examining boards around the country, they will almost inevitably 
be reflected in a change in the types of questions that this Committee 
has in stock. 


Second, the law schools themselves can help out here if they feel 
the Committee is getting in a rut in the types of questions it stocks, 
by themselves contributing questions in these new fields. For instance, 
we have very few questions on Administrative Law or Labor Law or 
Insurance. The Committee would like questions on these subjects and 
would be glad to offer them in the catalogue. The schools have a 
cordial standing invitation to contribute questions on any subject they 
wish. 

To summarize: The Bar Examination Service would be primarily 
a clearing house for questions. However, it would exercise a screening 
function also, in that it would try not to offer for distribution questions 
that do not seem useful or adequate for examination purposes in juris- 
dictions other than the state from which they were contributed. A 
continuous evaluation process takes place as examiners use questions 
from the Committee. They will help the whole program materially 
by reporting to the Committee on the Question Report Forms their 
reactions to the questions which they have obtained from the Com- 
mittee. 

The screening which questions and answers undergo in the Com- 
mittee is not essentially different from the screening process that each 
contributor goes through when he selects his questions to send in to 
the Bar Examination Service. The greater the care which the con- 
tributor takes in making his selections, the easier will be the evalua- 
tion job in the Committee and the better will be the service that the 
Committee can render for examiners. 

(To be continued in January, 1954, issue) 
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APPENDIX 


Summary, as of August 24, 1953, of replies to invitations by the Committee 
to participate in the Bar Examination Service Program. 


I. Contribution of questions to the Committee: 





Questions contributed by bar examiners (see Sec. II)......... Le 
Questions contributed by law schools (see Sec. V) on... ioeeceeencecestseteeeeeeeee ones 152 
Total questions contributed... 0... sascicbeea taint 


II. Contribution of questions by examiners: 


Number of Length of 

State Questions Questions 
Ee art nee eae ee eens PIMC eal em 169 Long 

” Florida (in cooperation with University of Florida) ............. (See Sec. V) 
Georgia ........... Oh Pinte pn aI Seine” tigeonehesmettie, Mixed 
Illinois ..... REM ba eae ae POLES yen ; . 103 Short 
nates ai Eee teecacs ciieks ee Short 
RT eeeeoee Pasabitsti She ean ce eaten . © Long 
Pennsylvania ...................... Sentient Rotel 40 . Long 
Total ..... on eae ae seabaascbudas 


Sixteen jurisdictions indicate that they will contribute questions in the future: 


Delaware (one examiner) Nevada Oklahoma (at discretion 
Idaho New Hampshire of individual examiner) 
Indiana New Mexico Oregon 

Michigan New Jersey Virgin Islands 

Minnesota North Dakota Washington 

Nebraska West Virginia 


One state is deferring decision until after the meeting of the Conference: 
Ohio 
Two states say that Board action will be necessary to determine whether they 


will or will not contribute questions: 
Rhode Island Virginia 


One state wishes to cooperate in the program but feels that special circum- 
stances make it doubtful whether it should contribute questions at present: 
Wyoming 
One state is non-committal: 
Montana 


Nine jurisdictions say that they will not contribute questions, at least at 
present: 


Connecticut Tennessee (Board will keep matter under 
District of Columbia review) 

Kentucky Vermont (though one board member of- 
Louisiana (civil law problem) fered to cooperate) 

Massachusetts Guam (has no written examinations) 
North Carolina 
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The remaining seventeen jurisdictions have sent no communication to the 
Committee in response to its inquiry: 


Alabama Mississippi 
Alaska Missouri 
Arizona Puerto Rico 
Arkansas South Carolina 
Colorado South Dakota 
Hawaii Texas 

Kansas Utah 

Maine Wisconsin 
Maryland 


III. Indication of intention to use questions made available by the Bar Exam- 
ination Service: 


Nineteen jurisdictions indicate that they would, or might, wish to use ques- 
tions from the Bar Examination Service: 


Idaho Nebraska Oklahoma (at discretion of 
Illinois Nevada individual examiner) 
Iowa New Hampshire Oregon 

Kentucky New Jersey Virgin Islands 
Massachusetts (doubtful) New Mexico Washington 

Michigan New York Wyoming 

Minnesota North Dakota 


One state is deferring action until after the meeting of the Conference: 
Ohio 
One state says that it probably will not use the questions from the Bar Exam- 
ination Service: 
California 
Sixteen jurisdictions, in their correspondence with the Committee, have not 


definitely indicated whether or not they would use questions from the Bar Exam- 
ination Service: . 


Connecticut Indiana Tennessee 
Delaware Louisiana Vermont 
District of Columbia Montana Virginia 
Florida North Carolina West Virginia 
Georgia Pennsylvania 

Guam Rhode Island 


The remaining seventeen jurisdictions have sent no communication to the 
Committee in response to its inquiry. (See list under Sec. II) 
IV. Indication of intention to use statistical service of the Committee: 


Fourteen jurisdictions have indicated that they would, or might, like to use 
the statistical service of the Committee: 


Florida Minnesota New York 

Idaho Nebraska Oklahoma (at discretion of 
Illinois Nevada individual examiner) 
Massachusetts New Hampshire Virgin Islands 

Michigan New Jersey Washington 
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One state is deferring decision until after the meeting of the Conference: 
Ohio 
Four states indicate that they will not use the statistical service of the Com- 
mittee: 
California (probably) Kentucky Pennsylvania Rhode Island 


Eighteen jurisdictions, in their correspondence with the Committee, have not 
definitely indicated whether or not they would use the statistical service of the 
Committee: 


Connecticut Iowa Oregon 
Delaware Louisiana Tennessee 
District of Columbia Montana Vermont 
Georgia New Mexico Virginia 
Guam North Carolina West Virginia 
Indiana North Dakota Wyoming 


The remaining seventeen jurisdictions have sent no communication to the 
Committee in response to its inquiry (See list under Sec. II). 


V. Contribution of questions by law schools: 
Number of Length of 


School Questions Questions 
Albany Law School, Union University (New York)............. 1 Long 
University of Piowitin (i ioridla) qn ecccccccesecnscseceesennnenecess 134* Short 
a, |; ae aa eee eE 10 Long 
Northeastern University (Massachusetts) ...............202........-.-.-.- 2 Long 
University of Notre Dame (Indiana)....... ORT ee eee 1 Medium 
University of Washington (Washington) ...............-.........-..2-.---- 1 Long 
Washington University (Missouri) ......-.......-..222..--..-..-2-20---0-0-0++ 1 Long 
Western Reserve University (Ohio) -2.2.....0.2..22222.00.c.cececeseeeeeos 1 Long 
College of William and Mary (Virginia)........... Ee ae, ee 1 Long 

SEES Ee TSENG SRE rere Ne eee EIN ea tO 152 


*These questions were contributed under a joint program of the Florida Board 
of Law Examiners and the College of Law of the University of Florida. 


Fifteen law schools have manifested a desire to cooperate with the Commit- 
tee but have as yet contributed no questions: 


Georgetown University (District of Stanford University (California) 
Columbia) State University of Iowa 

Gonzaga University (Washington) University of Arizona 

Loyola University (Louisiana) University of Kansas 

Ohio State University University of Kentucky 

Rutgers University (New Jersey) University of Nebraska 

St. John’s University (New York) University of Southern California 


Seton Hall University (New Jersey) Yale University (Connecticut) 


Two law schools have declined to contribute questions: 
Harvard University (Massachusetts) University of Richmond (Virginia) 
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